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1- (Currently Amended) An image processing apparatus -ftrr 
assuming a chai - actej-ia tic of a virtual intake a e n&iug optical 
s ystem, and applying a blur effecb corr e sponding Co a pica e L 
in foii us state to di captur e d ima g e r comprising: 
5 an image input unit for capturing image information 

including distance information to each portion of an object to be 
photographed; 

a parameter input unit for inputting a parameter from which 
an effective aperture and focal length of the an assumed image 
10 sensing optical system can be derived; 

an in-focal pirrt point position designation unit for 
designating an in-focal pint point position of the assumed image 
sensing optical system; 

a blur state calculation unit for calculating a blur state 
15 from the distance information input by said image input unit, the 
in-focal pint point position designated by said in-focal p i rrb 
PQXi xL position designation unit, and the parameter input by said 
parameter input unit; and 

an image processing unit for applying tire a blur effect to 
20 the image input by said image input unit in correspondence with 
the blur state calculated by said blur state calculation unit; 

wherein the i n-focal point position de_siQnated by said in- ' 
focal point positi on designation unit is determined using the 
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distance information includ ed in the imaae information, based 
25 apposition whi ch is designated by a user in an image 
corresponding to the imaae information . 

Claims 2 and 3 (Canceled) . 

4. (Currently Amended) An image processing apparatus £©r 
assuming a characlej.lstic of a uiifcual imag e s ei iairiy uptical 
system, and applying a blur eff e ct correspondin g to an in focuA 
staLfe Lo a captured im&g^, comprising; 
5 an image input unit for capturing image information 

including distance information to each portion of an object to be 
photographed; 

a parameter input unit for inputting a parameter from which 
an effective aperture and focal length of -Hro an assumed image 
10 sensing optical system can be derived; 

an in-focal p in t- poijfit position designation unit for 
designating an in-focal pint point position of the assumed image 
sensing optical system; 

a confusion circle calculation unit for calculating a 
15 confusion circle from the distance information input by said 

image input unit, the in-focal p i -rrfr point position designated by 
said in- focal pint point position designation unit f and the 
parameter input by said parameter input unit; 
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a blur state calculation unit for calculating a blur state 
using a point spread function (F0F) within a range corresponding 
to a size of the confusion circle calculated by said confusion 
circle calculation unit; and 

an image processing unit for applying -the a blur effect to 
the image input by said image input unit in correspondence with 
25 the blur state calculated by said blur state calculation uniti. 

wherein the in-foc al point position designated by said In- 
focal point position designation unit is determined using the 
distance informa tion included in the image information, based on 
a positi on which is designated by a user in an Image 
3° corresponding to the image information . 

5. (Currently Amended) An image processing method 
assuming a chaiacteriatic c£ a viiLual ima g e s e nsing o ptical 
system, and applying a blui - e ffect coi ' i -e apondiu g to a pmaeL 
in - focus state to a captuired image, comprising the a taps u£ : 
5 capturing image information including distance information 

to each portion of an object to be photographed; 

inputting a parameter capable of deriving an effective 
aperture and focal length of -the an assumed image sensing optical 
system; 

10 designating an in-focal pir rb point position of the assumed 

image sensing optical system; 
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calculating a blur state from the input distance 
information, the designated in-focal pitrtr point position, and the 
input parameter; and 
15 applying -the a blur effect to the input image in 

correspondence with the calculated blur states 

wherein thq in -focal point position designated bv said In- 
focal point position desig nation unit is determined usino the 
distance informati on included in the image information, based on 
a position whic h is designated bv a user in an image 
corresp onding to the image information . 
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6. (Currently Amended) An image processing method of- 
assuming a cha-r actcri^Lic ^f a virtual imaga sensing uptical 
ayaLfeiu, and applying a blui ^flecl iuiie6pondii ' ig to an in JTuiua 
state to a captured image, comprising th e atfcps u - f : 

capturing image information including distance information 
to each portion of an object to be photographed? 

inputting a parameter from which an effective aperture and 
focal length of the £n assumed image sensing optical system can 
be derived; 

designating an in-focal p int point position of the assumed 
image sensing optical system; 

calculating a confusion circle from the input distance 
information, the designated in-focal pint point position, and the 
input parameter; 
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15 calculating a blur state using a point spread function (rOFh 

within a range corresponding to a size of the calculated 
confusion circle; and 

applying -ttre a blur effect to the input image in 
correspondence with the calculated blur states 

wherein the in-focal point position designated bv said in- 
focal point position desig nation unit is determined using the 
distance informat ion included in the image information, based on 
a position in a n image which is designated bv a user . 

Claim 7 (Canceled) . 



8. (Currently Amended) An article of manuf acLui_g 
compris in g ; a A computer^readable storage medium having 
computer-readable program code means stored thereon to aaamifa a 
characteristic - of a virtual imaga sensing op tical system and 
apply a blur effect corresponding Lo a pr e set in - focus state to a 
captur e d image in an image processin g apparatus , said 
computer-readable program code means comprising: 

first computer-readable program means for providing a 
computer with a function of capturing image information including 
distance information to each portion of an object to be 
photographed; 

second computer-readable program means for providing the 
computer with a function of inputting a parameter from which an 



10 



-24- 
PAGE 24/35 1 RCVD AT 8/30/2004 5:22:57 PM [Eastern Daylight Time] * SVKUSPTO-EFXRF-1/5 * DNIS:8729306 1 CS1D:212 319 5101 1 DURATION (mm-$s):0M4 



Aug. 30. 2004 5:27PM 



FRISHAOF & PARTNERS 



No. 6635 P. 25/35 



Application No. 09/476,910 
Response to Office Action 



Customer No. 01933 



15 



effective aperture and focal length of the an assumed image 
sensing optical system can be derived; 



third computer-readable program means for providing the 
computer with a function of designating an in-focal p int point 
position of the assumed image sensing optical system; 

fourth computer-readable program means for providing the 
20 computer with a function of calculating a blur state from the 
input distance information, the designated in-focal pint point 
position, and the input parameter; and 

fifth computer-readable program means for providing the 
computer with a function of applying -the a blur effect to the 
25 input image in correspondence with the calculated blur states 

wherein the in-focal point position designated bv said in- 
focal point pos ition designation unit is determined using the 
distance informati on included in the image information, based on 
a posit ion which is designated bv a user in an image 
30 corresponding to the image information . 

9. (Currently Amended) An article ul maimfaoLum 
comprising, a A computer-readable storage medium having 
computer-readable program code means stored thereon fr s assum e a 
characteristic uf a virtual ima g e s e nsing optical sysLeiu and 
5 a p ply a blur affect corr e sponding to an in - fuma atate Lu a 
captured image in an ima g e processin g ap p aratus , said 
computer-readable program code means comprising; 
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first computer-readable program means for providing a 
computer with a function of capturing image information including 
10 distance information to each portion of an object to be 
photographed; 

second computer-readable program means for providing the 
computer with a function of inputting a parameter from which an 
effective aperture and focal length of -the an assumed image 
15 sensing optical system can be derived; 

third computer-readable program means for providing the 
computer with a function of designating an in-focal p in t point 
position of the assumed image sensing optical system; 

fourth computer-readable program means for providing the 
20 computer with a function of calculating a confusion circle from 
the input distance information, the designated in-focal p int 
point position, and the input parameter; 

fifth computer-readable program means for providing the 
computer with a function of calculating a blur state using a 
25 point spread function (P3F) within a range corresponding to a 
size of the calculated confusion circle; and 

sixth computer-readable program means for providing the 
computer with a function of applying the a blur effect to the 
input image in correspondence with the calculated blur states 
30 wherein the in-focal poi nt position designated by said in- 

focal point position designation unit is determined using thg 
distan ce information included in the image information, based on 
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3 position which is desig nated bv a user in an imag e 
corr esponding to the image information . 



Claim 10 (Canceled) . 

11- (Currently Amended) An image processing apparatus 
comprising: 

means for inputting image data including depth informations- 
means for setting a parameter for expressing a lens 
characteristic; 

means for setting «ny one of a focal length, F-number, field 
angle,, and effective aperture; 

means for setting a distance f or ad j usting a in focus; 
means for calculating expression of an image texture 
including a blur from -tire virtual camera setting values and the 
depth information of the image; and 

means for storing a calculation result in a memory 
wfreyein an in-focal point position is determined using t.h* 
depth information included in the imaoe data based on a position 
15 designed by a user in an image c orresponding to the image d^a . 

12. (Original) An apparatus according to claim 11 , further 
comprising means for inputting an image having depth information 
in units of pixels of a two-dimensional image. 
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13. (Currently Amended) An apparatus according to 
claim 11, wherein a blur function is a point spread function 

calculated in units of pixels from the focal length of a 
lens, the F-number or aperture, the an object distance, and the 



14. (Currently Amended) An apparatus according to 
claim 11, wherein a blur function has a variable function shape, 
and is one of a concave function trr and a. convex function 
determined by a focal pint point position and an object distance 
to be calculated. 

15- (Currently Amended) An apparatus according to 
claim 11, wherein a us e r ^an fj.wly chan g e, with a volume, the 
F-number and a focal pint point position designated by the user 
are adapted to be chan geable by the user with a sliding switch , 
and wherein a calculation result using a thumbnail image obtained 
by thinning out an input image is displayed to interactively 
obtain a confirmable parameter setting > 

Claim 16 (Canceled) . 

17, (Currently Amended) An apparatus according to 
claim 11, wherein a usex - freely change s the F-number with a 
vuluiue is adapted to be changea ble by the user with a sliding 
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depth information of the image data . 
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Switch while deaignaLiuy the user designates a focal pirrb point 
position on a designated window, and wherein a calculation result 
using a thumbnail image obtained by thinning out an input image 
is displayed to interactively obtain a parameter setting c a p able 
of liOmfimiiny which is adapted to confirm designation of the 
focal pint point position and the F-number. 

18. (Currently Amended) An apparatus according to 

claim 11 , wherein a user can chang e a zoom ratio is adapted to be 
changed bv the user by changing an f-number. 

19. (Currently Amended) An apparatus according to 

claim 11, wherein a central point of a zoom and a position to get 
into focus are set in setting a zoom ratio, and wherein central 
coordinates of the zoom and depth information of the central 
point are used to one of calculate a blur state and an 
enlargement on a window and a bluu state or to interactively 
determine a parameter. 



20. (Original) An apparatus according to claim 19, wherein 
an outer frame in an area to be enlarged and displayed without 
changing a display ratio is displayed in setting the zoom ratio. 

21. (Currently Amended) An apparatus according to 
claim 11, wherein a window is enlarged based on central 
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coordinates of a zoom designated by a user, a focal pint point 
position on the window is designated to determine the focal pint 
5 point position, the F-number is freely changed with a veiluuw 

Siding switch, and a calculation result using a thumbnail image 
obtained by thinning out an input image is displayed to 
interactively obtain a> parameter setting capabl e of coulinaiiiy 
which is adapted to confirm designation of a central position of 
10 the field angle, a zoom ratio, and the F-number. 

22. (Original) An apparatus according to claim 11, wherein 
a blur state is expressed using influence of coma which changes 
depending on a distance and azimuth from a center of an image. 

23. (Original) An apparatus according to claim 11, wherein 
an asymmetrical point spread function is calculated for coma 
using a blur function obtained by shifting a central position of 
a radius of a confusion circle in accordance with a distance from 

5 a central position of an image. 

Claim 24 (Canceled) . 

25, (Currently Amended) An apparatus according to 
claim 11, wherein a range d-A from d on a point spread function 
for a radius (d) of a symmetrical confusion circle is set as a 
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chromatic aberration influence range, and one of red aberrati 



Claim 26 (Canceled) . 

27. {Currently Amended) An apparatus according to 
claim 11, wherein one of a blue range or and a red range of a 
color characteristic at not less than a given distance is one of 
emphasized or and decreased. 

28. (Currently Amended) An apparatus according to 
claim 11, further comprising means for inputting, as a set of 
units, depth information and image information in units of one of 
pixels err and areas for each object. 

29. (Currently Amended) An apparatus according to 
claim 11, wherein an input image «• comprises a set of objects 
having a predetermined distance in units of not pixels taut sets 
of objects and not in units of pixels . 
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or and blue aberration is applied. 
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